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Abstract 

A notion of asymptotic Hamming distance suitable for the study of 
algorithmic randomness is developed. As an application of this notion, it 
is shown that there is no fixed procedure that computes a Mises-Wald- 
Church stochastic set from a complex set. Here a set is complex if its 
prefixes have Kolmogorov complexity bounded below by an unbounded, 
nondecreasing computable function. 
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From a distance the world looks blue and green, 
and the snow-capped mountains white. 

Julie Gold, 1985 



1 Introduction 

We are interested in the extent to which an infinite binary sequence X, or 
cquivalcntly a set X Q uj 1 that is algorithmically random (Martin-L6f random) 
remains useful as a randomness source after modifying some of the bits of X . 
Usefulness here means that some algorithm (extractor) can produce a Martin- 
Lof random sequence from the result Y of modifying X. 

If not too many bits of X are modified, the resulting set Y will have effective 
packing dimension 1. The question of the computational power of sets of positive 
effective Hausdorff dimension and packing dimension, as compared to random 
sets, was raised by Reimann and Terwijn around 2003 and to a great extent 
resolved around 2007. 

Let < s denote Medvedev (strong) reducibility and let < w denote Muchnik 
(weak) reducibility. 

Theorem 1.1 (Bienvenu, Doty, and Stephan [2]). For any real numbers < 
a < < 1, the collection of reals A with dim^A) > ft is not Medvedev reducible 
to the collection of reals with dim# (A) > a. 

In particular this showed that for each Turing reduction $ there is a set Y of 
positive effective Hausdorff dimension such that $ F is not 1-random. By work 
of Greenberg and Miller this can be strengthened, making Y not depend on $ 
and replacing 1-randomness by KL-stochasticity. 

Theorem 1.2. There is a set Y of effective Hausdorff dimension 1 such that 
no KL- stochastic set is Turing reducible to Y . 

Proof. Greenberg and Miller 8 show that there is a set Y of minimal Turing 
degree and effective Hausdorff dimension 1. It is easy to see that a KL-stochastic 
set cannot have minimal Turing degree, because if Y = A © B then we can use 
the bits in A to bet on the bits in B. □ 

In the present article we show that by weakening Hausdorff dimension to 
complex packing dimension fDcfinition I3.14|) . and weakening < w -reducibility 
to < s -reducibility, we can improve the conclusion about KL-stochasticity to 
MWC-stochasticity. 

Definition 1.3. An element of2 UJ is Mises-W aid- Church (MWC) stochastic if 
no partial computable monotonic selection rule can select a biased subsequence, 
i.e., a subsequence where the relative frequences of Os and Is do not converge to 
1/2. 
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Definition 1.4. An element of 2^ is Kolmogorov-Loveland stochastic if no par- 
tial computable (non-monotonic) selection rule can select a biased subsequence, 
i.e., a subsequence where the relative frequences of Os and Is do not converge to 
1/2. 

Theorem 1.5. There is no single Turing reduction $ such that for each set Y 
of effective packing dimension 1, $> Y is MWC- stochastic. 

Actually, Theorem 11.51 arises as a corollary of a theory of information ex- 
traction in terms of Hamming distance that we develop an asymptotic version 
of herein. Information will come in two forms, randomness and diagonal non- 
recursiveness. A set that has small Hamming distance from a random set may 
be viewed as the result of an adaptive adversary corrupting or fixing some bits 
after looking at the original random set. Similar problems in the finite setting 
have been studied in computer science going back to Ben-Or and Linial pQ. 

Similarity and mega-standard similarity. If A is a finite set and er, r e 

{0, 1} A then the Hamming distance d(a, r) is given by 

d(o;T) = \{n : a(n) ^ r(n)}| . 

Following Buhrman et al. [3] we write b(n, k) := (q) + " " + (!■) ■ If a truth-table 
reduction $ has disjoint uses on distinct inputs then it is natural to define, for 
a function p : w — > uj, 

X~ PtV Y <^> (3N)(Vn > N) \(X + Y) D tp[n)\ <p(n). 

Let the collection of all infinite computable sets be denoted by £. Let p : 
oj -> uj. For X, Y € 2" and N e £ we write 

I~ p ,jvY (3n )(Vne N, n>n ){d(X \ n,Y \ n) <p{n)). 

X ^ p Y <^=> X Y. 

X~ p Y ^ (3Le £){X ^ PiL Y). 

In this paper we will develop a good understanding of x p and randomness 
extraction. In the future one may hope to develop a similar understanding for 

The relation x p has a certain beauty that ~ p lacks. If X is random then, 
by Weber's law of the iterated logarithm for subsequences, X x p whenever 
p(n) = n/2+cj*( v / n); whereas for ~ p one has to add iterated logarithms into the 
picture. So X is the sense in which deviations do not exceed standard deviations 
by more than a constant amount. We can call x mega-standard similarity and 
say that whereas the similarity of X and is only n/2 + (1 + e)y/2n\og logn, 
the mega-standard similarity is lower, namely n/2 + uj*(y/n). We can say that 
whereas the asymptotic Hamming distance between X and is bounded by 
n/2 + (1 + e)\J2n log log n, the mega-standard Hamming distance is bounded by 
n/2+uj*(y/n). 



3 



The mega-standard asymptotic deviation "is c • \fri\ i.e., it is bounded by 
f(n) iff f(n) is an unbounded nondecreasing function times the standard devi- 
ation. The asymptotic deviation is bounded by (1 + e)y/2n In Inn. 

Thus if X x p Y then we say that X and Y differ at most by p asymptotically, 
although this would be more natural if N = u. 

Let us use the following notation: 

[X] p = {Y:Y~ p X}. 

Moreover, 

[A] P = \J{[X] P :XEA}, 
and similarly for [X] Pi jv and [-X]p,<p. 

2 Positive results 

2.1 Extracting DNR functions 

Let DNR denote the set of diagonally non-recursive functions. We consider the 
problem of extracting a member of DNR from a set close to a random set. 

Theorem 2.1 (Michel Weber's Law of the iterated logarithm for subsequences 
|15j). Let v\ < 1/2 < • • • be an increasing sequence of natural numbers and let 
{Y n } be an i.i.d. sequence with¥,(Y n ) = and¥,(Y^) = 1. Let S n = Yi+- ■ -+Y n . 
Let 

Pn = \{m < n : {uj}^ fl {2 m ~\2 m ] £ 0}| 
A(fe)=lnp„ if fee(2 n_1 ,2 n ]. 

Then we have 

limsup V] = = 1 a.s. 

Remark 2.2. In this article, log denotes log 2 and In denotes log e . Note that 
if a = 2 e then In log a = x, whereas 

In In a = \n(e x In 2) = x + In 2, 

so tta< lnlog 2 ~ In In. 

The theorem, the remark, and letting Uj — j yields the 

Corollary 2.3 (Law of the iterated logarithm). Let Y n be independent, iden- 
tically distributed random variables with means zero and unit variances. Let 
S n =Yx + ... + Y n . Then 

hm sup = = 1 

n-foo V2nlnlnn 

almost surely. 
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We say that / e u> u is an order function if / is unbounded, nondecreasing, 
and computable. 

Theorem 2.4. For each order function f there is a computable set {vj}j>i 
such that A(k) < f(k) for almost all k. 

Proof. Since A(fc) = lnp„ where n = log 2 k, it suffices to show that n i->- p n 
can be arbitrarily slow-growing, which is clear by taking {vj}j>i sufficiently 
sparse. □ 

Note that \X \ n\ = d(X \ n, \ n). For any A e 2" we may consider X + A 
given by 

(X + A)(n)=X(n)+A(n) mod 2. 
Then \(X + A) \ n\ = d(X \n,A \ n). 

Theorem 2.5. Let X be the random variable given by ¥(X e S) = \(S). For 
each A, the distribution of X + A is equal to the distribution of X. 

Theorem 2.6. If X is Kurtz random relative to A then 

d(X \n,A \n)- § 



Proof. 



hence 



limsup - > 1. 

n-s-oo v2nlnlnn 



I x M = ]T x fe = 1 ]T ( r fe + 1 ) = ^ + s„ 



2 

k<n k<n 



in particular 



hm sup — = f 

n^oo V2nlnlnn 

hmsup = > f , 

n-s-oo v2nlnlnn 

(Ve > 0)(VJV)(3n > N) LjjLI > i _ e \ and 
V V2nlnlnn / 

(Ve > 0)(V7V)(3n > N) (\X \ n\ > | + (1 - e)V2nlnlnn) . 

almost surely. This is a II2 class of measure 1, hence each Kurtz random belongs 
to it. □ 



Definition 2.7. Let 



?M") = I + V 2nA (n), 



<pN, s ( n ) = g + ( J _ s)y/2nA(n), 

Theorem 2.8. If X e MLR and X -~^ W ei jv ^4 /or some AT € £ then A computes 
a DNR function. Conversely for each N e €, X ~^, Ni n and does not 
compute a DNR function. 



5 



Proof. If A does not compute a DNR function then A is Low(MLR, Kurtz) by 
0. Note that by Theorem [2T6l {X : X ~^ e ,jv ^4} is and of measure 

zero, hence contains no real that is Kurtz random in A, hence contains no 
ML-random real. □ 

Definition 2.9 (Effective convergence). Let {o n } neu be a sequence of real num- 
bers. 

• {«n}neu converges to oo effectively if there is a computable function N 
such that for all k and all n > N(k), a n > k. 

• {« n }n6u converges to effectively if the sequence {a" 1 },^^ converges to 
oo effectively. 

Definition 2.10. For a sequence of real numbers {a n }„ ew , 

* 

lim a n 

n— 7-oo 

is the real number to which a n converges effectively, if any; and is undefined if 
no such number exists. 

As a kind of effective big-0 notation, p — io*(q) means lim* q/p = 0. 

Theorem 2.11. // / is any function with f{n) — n/2 + cj*(y / n) then DNR is 
not Muchnik reducible to 

\J [MLR] f<N . 

Nee 

Proof. It suffices to show that £ [MLR]/, at for some N E £, since clear 
computes no DNR function. By assumption f(n) = n/2 + g(n)^/n where 
lim* g(n) — oo. By Theorem 12.11 there is a subsequence {^j}j>i such that for 
almost all X, X ^/.n & where N = {vj}j>i- □ 

2.2 Extracting randomness 

Notation. If X e 2" then X is called a real, a set, or a sequence depending 
on context. If / C w then X \ I denotes X, viewed as a function, restricted to 
the set /. We denote the cardinality of a finite set A by |^4|. Regarding X, Y as 
subsets of cj and letting + denote sum mod two, note that (X + Y)C\n = {k < 
n : X(k) ^ Y{k)} and generally for a set / C u, (X + Y) n / = {k e I : X(k) ^ 
Y(k)}. If $ is a truth-table reduction, we define the use of Q x (k) by 

tp(k) = {neuj: (3Z) $ z ^ n > (jfc) ^ <$> Zu{n} (k)} . 

Majority preserves randomness. The Lebesgue measure on [0, 1], or equiv- 
alently the fair-coin measure on 2", is denoted by A. For an introduction to 
Martin-L6f randomness the reader may consult the book by Nies [H] . Let MLR 
denote the set of Martin-L6f random elements of 2". We use the set-theoretic 
notation for image, 

R[A] = {y:pxeA){{x,y)€R}. 
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Lemma 2.12. If $ is a Turing reduction such that the random variables X and 
$ x have the same distribution, i.e, A = A o then $[MLRJ C MLR. 

Proof. Let {U n } n&u be any Martin-L6f test, and let V n = {X : $ x 6 J7 n }. 
Then 14 is uniformly E° and AV^ = AZ7 n , so {V n } neu} is a Martin-L6f test. 
Therefore, if X e MLR then X a n V n and hence $ x ^ n„£/„. □ 

Let Dk be the finite subset of ui with canonical index k, and let 

odd I -Cfe ^ l-^fe| is an °dd number or = 0, 



Let 



Dk \ {max(Z)fe)} otherwise. 



Maj x (fc) = 1 |D° dd n JCl > |^ dd \X| 



This Turing reduction Maj is not itself a randomness extractor, but a simple 
modification will be. 

Lemma 2.13. If f is a computable function such that 

1. Df(k) 7^ for each k, and 

2. D/(fc) n Dfy) = for all k ^ I, 
and $ x (fc) = Maj X (/(fc)) for all k, then 

(a) the distribution of X H> & x is equal to A, and 

(b) $[MLRJ C MLR. 

Proof. By (p}, -Dj dd j is a nonempty set of odd cardinality for each k, so \{X : 
= 1} = 1/2 for each k. By ©, the random variables {& x (k)} keLU , are 
mutually independent. Therefore (a) follows. Part (b) follows from (a) and 
Lemma [2~T2l □ 

Central Limit Theorem. Let Af be the cumulative distribution function for 
a standard normal random variable; so 

V27T J_oo 

Let P denote probability. We will make use of the following quantitative version 
of the central limit theorem. 

Theorem 2.14 (Berry-EsseerQ). Let {X n } n >i be independent and identically 
distributed real-valued random variables with the expectations E(X n ) = 0, E(X 2 ) = 
a 2 , and E(\X n \ 3 ) = p < oo. Then there is a constant d (with .41 < d < .71) 
such that for all x and n, 



< dp 



x See for example Durrett [5], 3rd edition, page 124. 
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We are mostly interested in the case X n — X(n) G {0, 1} for Ie2 u under 
A, in which case a = 1/2. 

Corollary 2.15. If g : uj — >■ uj with lim„_>. 00 g(n) — oo and S n = Ylf—x Xi where 
a = 1/2 then 

n\Sn\<g(n))=0(g(n)/Vn-) 
Proof. The Berry-Esseen Theorem 12 . 141 with c := dp/ a 3 gives that for all n, 

(_Sn 



< x - Af(x) 



< 



Thus using j\f(x) +Af(-x) = 1, and the fact that for x > 0, j\f(x) < \ + 
we have 



\\S n \ < xVn~/2) 



( Sn 



VvV2 



< x 



- P I - 



VvV2 



< -x 



2c 2x 2c 



= 2jV(x) - 1 + < 2 
So if we substitute x — 2g(n)/y/n, 



n 

1 x 
2 + 7/2^ 



In V27T V n 



.xx 4o(n) 2c q(n) 
'{ S n < g{n)) < -^== + -= < const • ^J- 
V2nn y/n Jn 



for large enough n. 



□ 



Majority extracts randomness. 

Theorem 2.16. Suppose f and g are computable functions. For each k G uj, 
let $ x (fc) = Maj x (/(fc)) for all X G 2" and let n k = \D f(k) \. Suppose that 
the sets ip(k) — f/(fc) are disjoint and nonempty. Suppose n k +i > n k for each 
k G uj, and lim^oo n k = oo. Suppose g(n) — o(y/n) and g(nk)/ \/n~k < 2~ fc for 
all k. Then 

(yX G MLR) ( VY X)($ y G MLR), i.e., 
$[[MLR]g !V ] C MLR. 
Froo/. Let 4 = D°*d and n odd = ^ 

S (fc) = = ^ [ ^( t ) _ M ) and note that 

tei k ^ 2 J 

<$> z = {k : S {k) [Z] > 0}. 
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Since the sets Ik are disjoint and nonempty, by Lemma r2.13l we have $[MLR] C 
MLR. Let 

U m = [Z : (pk > m)\S^[Z]\ < ,g(n fe ))} . 

Note that {U m } meuj is uniformly Sj. 

Applying Corollary 12.151 to n 4 g(n + ) where n t— > n + is the inverse of 
n i — ^ n odd gives a constant C" and an iV such that for all n > N, 



< 9{nk)) < C 



9(rik) . „ g{n k ) 



< C 



for another constant C. Since lim^oo n k — oo, there is an M such that for all 
hus for m> M, 

X(U m ) < J2 X{Z:\SW[Z]\<g(n k )} 



m>M,n m >N. Thus for m > M 



< 



. ATT — ^-^ 



fc>m v k>m 

Thus {P m }m6u is a Martin-L6f test (in the extended sense). Let X € MLR. 
Then there is an m with X ^ f7 m , hence 

(Vfc>m) |S (fc) [X]| >. 9 (n fe ). 

Let y be such that Y „ X; then 

(Vfc > to) $ y (fc) = $ x (fc). 

By Lemma $ x G MLR, and thus $ Y G MLR. □ 

We can derive a version of Theorem 12.161 for the similarity relation ~ p as 
follows. 

Lemma 2.17. Let N £ £. If p : to to and g : {n/2 : n £ to} —> to are order 
functions with g(n/2) = p(n) for all n, and $ is a truth-table reduction whose 
uses <p(n) are disjoint finite sets with \<p(n)\ > Ylk=o 1^(^)1; vain(p(n + 1) = 
max.((p(n)) + 1, and X^l'Lo lv(^)l ^ N for all m, then for all X , Y , we have 

X ~p,at Y =>■ X Y. 

Proof. Let X ^ p Y and n m = |y>(m)|. This yields for all m, 



\(X + Y)ncp(m)\ < 



(X + Y)n 

\fc=0 / 



< P ( n fe ) = 9 ( 5 H ™ fc ) - 

\fe=o / V fe=o / 



□ 
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Theorem 2.18. For each order function p such that p(n) = o(^/n) and each 
N £ £, there is a truth-table reduction $ such that 

$[[MLR] P:A r] C MLR. 



Proof. Let g : {n/2 : n £ cj} — > u> be an order function such that g(n/2) = p(n) 
all n. Note that sM. 
Define h : to — >• M by 



for all n. Note that = ^2 ■ -> 



n(n) 



9(n)' 

so lim„ h(n) — oo. We may assume lim„ g{n) = oo, since otherwise we may take 
$ to be the identity map $ z = Z. Thus we can let k H ► rife be a sufficiently 
fast-growing computable sequence to guarantee that 



-l 



h(n k ) 



< 2- k , n m > 



rik, 



fc=i 



and X^fcLo ^ ^ f° r a ^ m - Let ?k = Df(k) be disjoint finite sets of size rife 
such that min/fe +1 = max//. + 1. For each £ u>, let $ x (/c) = Maj x (/(A;)) for 
all Ie2 u . By Lemma EOH if X ~ P)W Y then X F. By Theorem [535] 
we are done. □ 



3 Negative results 
3.1 The Hamming cube 

The Hamming distance between a point and a set of points is defined by 
d(y, A) ;= min ae ^i d(y, a). The ^-neighborhood of a set A C {0, 1}" is 

T d (A)={y £{0,1}" :d(y, A) <d}. 

In particular, 

T d ({c})={y£{0,l} n :d(y,c)<d}, 

and 

T d (A) = |J T d ({a}). 

A Hamming- spher^ with center c € {0, 1}™ is a set S C {0, 1}™ such that for 
some fc, 

r t ({c})acr w ({ c }). 

Theorem 3.1 (Harper [9]; see also Frankl and Fiiredi [6j). For each n > 1 and 
eac/i set A C {0, 1}™, there is a Hamming- sphere S C {0, 1}" such that 

\A\ = \S\, and 

\Td(A)\ > \T d (S)\ . 

2 A Hamming-sphere is more like a ball than a sphere, but the terminology is entrenched. 
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Note that for all c G {0, 1}™, |r fe ({c})| = b(n, k). We define 
B' r (a) = T d ({a}) = {re {0, 1} J : d(a, r) < r}. 
Unless otherwise indicated, the probability P of a set E C {0, l} 7 is by definition 

P(E) = M 

i.e., P is counting measure scaled to be a probability measure. 

Lemma 3.2 (Key Lemma). Let © G a/**. Suppose 

* 

lim ©(n)/y/n — oo. (1) 

Lei / G w w &e a computable function. Let I m = D f( m ^ and n rn = \I m \- Suppose 

lim n m = oo. (2) 



m— >oo 



-For eac/i m £ uj let E m C {0, l} /m . Suppose limsup m _ i . 00 P(_E m ) < p where 
< p < 1 is computable. Writing 

P(£©(»)P0 C £ m ) := P(S^ (nm) (X r 7m) C £ m ), 

we /iave 

lim P(B @fn x(X)CE m )=0. (3) 

Moreover, for each tuq G and computable q G (p,l) £/iere is a modulus of 
effective convergence in that works for all sets {E m } meu such that for all 
m > m , ¥(E m ) < q. 

Proof. Let p m = P(E m ). Let r = r m be such that 

o(n,r) < \E m \ < b(n,r+l). 



Let 
Then 

Let us write 



q t = b{n,t) ■ 2- n . 
q r < Pm < q r +i- 



B t (X) :=B^(X \I m ), 

considering X \ I m as a string of length n. By Harper's Theorem 13.11 we have 
a Hamming sphere H with \H\ = \-iE m \ and 



r ©(n)(^ £ '™) ^ T ©(n)( H ) 



i.e., 



3 Recall that D m is the m th canonical finite set, and note that we do not assume the sets 
I m are disjoint. 
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¥({x : x e r @(n) H? m )}) > p({x : x e r @(n) (#)}). 

Therefore 

v({x : x $ r @(n) H? m )}) < P({X : X g r @(n) ff)}). 

Let 7? be the complement of H . Then 

¥({X : B© (n) (X) C E m }) < P({X : B @(n) (X) C jj}). 

If the Hamming sphere il is centered at c € {0,1}™ then clearly the complement 
is a Hamming sphere centered at c, where c(fc) = 1 — c{k). Since p m 2 n = \E m \, 
H = \E m \, and p m < q r+1 = b(n,r + l)2~ n , we have H C r b( „ ir+1 ) ({c}), so 

P(S©(n)(*) c ff) < P(S @(n) (X) C r b(n , r+1) ({c})) 
_ fe(n,r + 1 - ©(n)) 

If we let X € 2" be a random variable whose distribution is A, then we can 
define the further random variable 

S (m) = X(i) 



iel,r 



and note that 



?r+i-©(») = F [S M < r + 1 - ©(n)] 



Let = Xi — K(Xi) where K(Xi) = | is the expected value of Xi, so E(3^) = 0. 
By the Berry- Esseen Theorem I2.14( for all x 



< x J - W(x) 



< 



dp 



where p = 1/8 = E(|Yi|' ), and a = 1/2 is the standard deviation of Xi (and 



Yi). Thus if we let 



then 



fm(x) = P 



S^™) - n/2 



< x 



|/ m (x)-^(x)| < 



Since lim^ rt m = oo, lim 



* d 



= 0. So 



lim sup|/ m (x) - Af(x)\ = 0. 



(4) 



Let 



y/H/2 



and b m 



1 



©(n) 
V^/2 ~ y/E/2 ' 
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Then 



B [S {m) < r + l-©(n)] 



S (m) 



< 



l-2_©( n ) 



© 



By O, 



We have 



lim \f m (b m )-Af(b m )\=0 



fm(b ri 



(5) 



limsup/ m (a m ) = lim sup 1 



S( m ~> -n/2 r. 



m 2 



vV 2 " y/n/2 
= lim sup P^*-™- 1 < r m ) = limsupq,.^ < lim sup p m < p 

m— >oo m— foe m— >-oo 

Since / m — > J\[ uniformly, it follows that 

limsupA/"(a m ) < p. 

TCI— T-OO 

and so as A/" is strictly increasing, 

lim sup a m < 7V _1 (p) (=0ifp = l/2). 

171— >oo 

Since 



lim 



1 



y/n/2 



0. 



and by assumption lim* ©(n)/y / n = oo, we have that b m is the sum of a term 
that goes effectively to 0, a term that goes effectively to — oo, and a term whose 
lim sup is at most Af~ 1 (p), so that after a fixed term it never goes above say 
A/" _1 (p) + 1 again. Thus 



and so 



lim b r , 



limA/'O™) = 0. 



Hence by (0, lim* / m (6 m ) = 0. Since we showed that lim* f m (b m ) = 0, and 
since by assumption lim* n m = oo, 

lim P(B @M (X) C E m ) = 0. 



□ 
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3.2 Stochastically dominated sets 

Let fix and fx 2 be probability measures on sample spaces fii and f2 2 an d let E be 
a measurable subset of Q,± x Q, 2 . The projections of E are E x = {y : (x, y) e E} 
and E y ~ {x : (x, y) e E}. 
We may write 

P(Event) = \{X : X e Event}. 
Theorem 3.3. Suppose that i], a, and 5 are positive real numbers such that 

HiEy > r] (Vy e 2 ), and (6) 
mix : [i 2 E x < a} > 1 - 8. (7) 

Then r\ < a + S. 

Proof. By Fubini's theorem, 



V < ^i{ E y)d^{y) = I J E(x,y)dfj, 1 (x)dfi 2 {y) = fi 2 (E x )dm(x) 
< a ■ ^{x : \i 2 {E x ) < a} + 1 • m{x : [i 2 {E x ) > a} < a ■ 1 + 1 • 8. 

□ 

Definition 3.4. A set X is immune if for each N <E N % X. If uj\ X is 

immune then X is co-immune. If X is both immune and co-immune then X is 
bi-immune. 

Definition 3.5. A set X is stochastically bi-immune if for each set N G 
X \ N satisfies the strong law of large numbers, i.e., 

,. \xr\Nnn\ l 

hm r~rz ; — = -. 

n->oo \Nf]n\ 2 

Definition 3.6. Let < p < 1. A sequence X e 2" is p-stochastically domi- 
nated if for each L G £, 

hmsup J > (3M e£) MCL and hmsup — — — - < p. 

n—>oo Tl n^oo \M C\ Tl\ 

The class of stochastically dominated sequences is denoted SD = SD p . If lo\X e 
SD p then we write X <G SD P and say that X is stochastically dominating. 

It is clear that each MWC-stochastic set is ^-stochastically dominated and 
clearly each finite set is in SD p for each p. 

Definition 3.7. For a real X and a string a of length n, 

(a \X)(n) = i f n< \ <T \> 
\X(n) otherwise. 
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(a-X)(n) 



a(ri) ifn< \a\, 

X(n— |cr|) otherwise. 

Thinking of a and X as functions we may write 
a \X = crU {X \uj\\a\) 
and thinking in terms of concatenation we may write 

o~X = aX 

Lemma 3.8. Let $ be a Turing reduction such that 

A($- 1 [SD p ]) = l (8) 

and let & x = <J> ctX ^. Then for any finite set E C 2 <u , a subsequence of the ran- 
dom variables {Q x (i)}i euj converges to a distribution stochastically dominated 
by the p-coin distribution uniformly over a £ E, i.e., 

(VE)(Ve > 0)(Vi )(3i > i )(V<r G E) 

P({X| $f(i)=l})< P + £. 

PVoo/. First note that for all cr € 2 <w , A^" 1 [SDpJ = 1 as well. 
Suppose otherwise, and fix e, io and E such that 

(Vi > io){3o- £ E) P($*(i) = l)>p + £. 

By density of the rationals in the reals we may assume e is rational and hence 
computable. Since there are infinitely many i but only finitely many cr, it follows 
that there is some a such that 

(3°°fc>; ) P($^(fc) = l)>p + e (9) 

and in fact 

limsup \{k < n : P($*(fc) = 1) > p + e}| /n > 0. 

Fix such a a and let VP = Let {£ n }n<£ui be infinitely many values of k 

in © listed in increasing order; note that C = {^„}„e w may be chosen as a 
computable sequence. 

For an as yet unspecified subsequence K — {k n } neuJl K. C L, let 

E = {(X,n):V x (k n ) = l}. (10) 

We obtain then also projections E n = {X : * x (fc„) = 1}, E x = {n : * A "(/c„) 
I ■ . By (|9]) we have for all n E oj, 

XE n >p + s. (11) 



4 In a different sense from SDp. 
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The fraction of events E n that occur in N = {0, . . . , N — 1} for X is denoted 

\E X f]N\ 

e N ,x = N 

By assumption flSJ), 

A [x : (3/C C £)(3M)(ViV > M) (e N , x < P + |) } = 1. 

Thus there is an M and a /C (using that £ is countable) such that 

A {X : e M ,x < P + |} > A {x : (VJV > M) ejv ,x < P + |} > 1 - |. (12) 

Let fii be the unit interval [0, 1]. Let fl 2 = M = {0, 1, . . . , M - 1}. Let m = A. 
Let /i2 = card be the counting measure on the finite set M = {0, 1, . . . , M — 1}, 
so that for a finite set A C M, card(^4) is the cardinality of A. [j Let rj = p + e, 
a = p + e/2, and 8 = e/3, and note that rj > a + 8. By JTTJ, ([12]) and Theorem 
13 - 31 1] < a + 8, a contradiction. □ 

Let the use ip x (n) be the largest number used in the computation of $> x (n). 
(This is slightly different from our earlier definition of use.) We write 

$ x (n) i @s 

if $ x (n) halts by stage s, with use at most s; if this statement is false, we write 
$ x (n) f ©s. We may assume that the running time of a Turing reduction is 
the same as the use, because any X-computable upper bound on the use is a 
reasonable notion of use. 

Let IM denote the set of immune sets (i.e., sets that are infinite but contain 
no infinite computable sets), CIM the set of co- immune sets (i.e., sets whose 
complements are immune), SD P the set of complements of sets in SD p , and 
W3R the set of weakly 3-random sets. 

Theorem 3.9. Let p : lj — > to be any computable function such that p(n) = 
a;* (\/n). Let $ fee a Turing reduction. There exists an N G £ and an almost 
sure event A such that for all X G A, there is a set Y ~ p ,jv X such that $ y A, 
i.e., 

(vxeA) $pry £ A 

More specifically, let A = W3R and 

B = (SD P n CIM) U (SD P n IM). 
Then XA = XB = 1 and 

(VIei)(3F~ p I)($ y ^6). 

5 In this case, f iii(Ey)d^2(y) = f Hi(E n )d[i2(n) = f X(E n )d card(n) = 
E„ e n 2 MEn) card({n}) = \(E n ) ■ 1. 
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Proof. Let S = {X \ BY ~ p X $ y g MLR}. Let p < 1 be computable. We 
show 

1. If A($- 1 [SD P ]) = 1, or A($- 1 [SD P 1) = 1, then 

MLR C {X : (BY ~ p X) $ Y g CIM} C 5, or 
MLR C {X : (3F ~ p X) $ y £ IM} C 5, respectively. 

2. Otherwise; then 

W3R C {X : (BY =* X) $ r £ SD p and (BY =* X) $ r £ SD P } C 5. 

Proof of (2): If we are not in case (1) then \{X \ § x e SD p } < 1, so by the 0-1 
Law, \{X | (VY =* X){<P Y G SD p )} = 0. This is (contained in) a 11° null class, 
so if X e W3R then (BY =* X)($ y £ SD p ) hence since MLR C SD p , I e 5. 
So we are done. 
Proof of (1): By Lemma [3~8l 



(Bp < l)(Ve > 0)(Vn)(Vi)(3£' > i)(V«r € 2 =n ) 

P({Z : $ CT ^ z (i') = 1}) < P + e; (13) 

Since $ is total for almost all oracles, it is clear that i' is a computable function 
f(k,n) of e = and n. Let j : w -) w be the computable function with 
lim n _ ) . 00 g(n) = oo given by g(s) = 2s. Let n = and i = 0. Assuming s > 
and n s and z s have been denned, let 

i-s+i = f(g(s),n s ), 

and let n s +i be a stage at which $ has converged a great deal, i.e., so large that 

(We 2="-) A{Z|$^ z ( is+1 )t@^ s+ i}<^, (14) 

2s 

and such that n s+ i is large enough that 

p(n s+ i - n 



->* oo and ^p(n fe+ i - n fc ) < p(n s+1 ) 



This completes the definition on the function s i— > (n s , i s ). Note that since i' > i 
in [TBI we have > i s and hence i? := {io, i\, . . .} is a computable infinite set. 
We now have 

(V S )(Va € 2=™*) F({Z : <T^ S+1 ) - 1}) < p + ^ (15) 



so 



P({Z : $^ Z (i s+1 ) 1= l@n s+1 }) < p + 1. (16) 

zs 
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Note [a, b) = b\a. 

Let X e MLR. We aim to define Y ~ p X such that $ y £ MLR. We will in 
fact make Y <t X, so we define a reduction S and let Y = E x . Since we are 
defining Y by modifying bits of X, the use of S will be the identity function: 
£ x (n) = n. 

Recall that no = 0. Thus we have no choice but to declare that Y \ tiq 
equals the empty string. So suppose s > and Yj- na has already been defined. 
The set of "good" strings now is 

G = {ryY tna $ T ^(i s+ i) = 0}. 

Define the "cost" of r to be the additional Hamming distance to X, i.e., d(r) = 
\(X + r)n[n s ,n s+ i)\. 

Case 1. Q ^ 0. Then let Y^ ng+1 be any t G Q of length n s _(-i and of minimal 
cost, i.e., such that d(ro) = min{d(T) | r G Q}. 

Case 2. Otherwise. Then make no further changes to X up to length n s+1 , 
i.e., let Ffn 3 +i = \ -X" r „ a+1 . 

This completes the definition of S and hence of Y". It remains to show that 
$ y £ MLR. Let 

£ s+ i = : -. ($ ctX " z ^ + i) |= 0@n s+ i) , where <r := E x \ n s } . 

= : ($^ z (z s+1 ) |= l@n s+1 ) , where u := E x \ n s } 
U {Z : (<S> aS * z (i s+1 ) | @n s+ i) , where a := ~ X \ n s } 

Since (fH| and (|TB|) hold for all strings of length n s , in particular they hold for 
a = E x f n s , so 

(Vs) P(£ s+1 ) < p + -L + -L = p + i hence lim P(£ s+1 ) = p. (17) 

Let 

C/f r»- = {Z : S p(ns+1 _ na) (Z) C £ s+1 }. 

One may say that the oracle for E s+ \ is X \ n s , and the Hamming cube for 
E s+1 is {0,1}["-"^) 31 f[n s ,n s+1 ). 

By LemmaP P(C7 S X ^) -> effectively, for all X e 2", using 

- ra s ) 
— — > oo. 

Also by Lemma \3 . 2 1 there is an effective modulus of convergence h(s) that only 
depends on an upper bound for an sq such that for all s > so, P(-E s +i) < q 
(where p < q < 1 and q is just some fixed computable number). Since by (| 1 T|) 
such an upper bound can be given that works for all X, actually h(s) may be 
chosen to not depend on X. Finally, a diagonalization: let 

V S = {Z:Z eU? fn >}, 
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then V s is uniformly Ej 1 . To find the probability of V s we use the law of iterated 
expectations: for two random variables A and B on the same probability space, 
E(A) = E(E(A | B)) = E b [E(A | B = b)}. We get 

P(y s )=E(Vj=E(E(V s | Z\n s )) 
= E a [E{l Vs | Z t , lB = a)} = E CT [E(1^ | Z [ns = a)] = E (T [E(l t/ z r „. | Z r „ s = a)] 

= E(E(l [/f r ». | £ r ««)) < E (M*)) = 
so since lim*^^ /i(s) = 0, {V^} s£w is a Martin-L6f test. Let {m s } seuj be a 
computable sequence such that X) s >t M TO s) — 2 _t - Let VK t = U s >t Then 
F(W t ) < 2"* and VK t is uniformly E?. Since X e MLR, X £ W t for some f and 
hence X £ V me for all but finitely many s. So <£> Y (m s ) = for all but finitely 
many s, hence $ y ^ CIM. By construction, we have 

\(X + Y) n [n s ,n s+ i)| < p(n s+1 - n s ) 
for all but finitely many n. Therefore 

|pf + F)n[0,n s+ i)| < 5^p(nfc+i -n fc ) <p(n s+ i) 

fc=0 

so X ^ p ,at Y where N — {n s : s e uj}. □ 

3.3 Complex versus MWC-stochastic sequences 

There are three notions of stochastically dominating immune (SDI). 
Definition 3.10. Assume A is immune. 

1. A is SDI if for each JVeC, liminf„ e Ar > p. 

2. A is densely SDI if for each N e €, there is M e €, M C N , with 
liminf„ eM > P- 

3. A is weakly SDI (SDI~ ) if for each JVeC of positive upper density, there 
is M e <£, M C TV , with liminf neM > p. 

Note that SDI - = SD 1/2 nlM. 

Theorem 3.11. If A <G SDI then A is not computably traceable. 

Proof. We trace the function f(n) = A \ I n e D h ^ n ) where J„ are large (size £) 
disjoint intervals and Dhf n \ = {(To, ai, . . .} is of size p(ri). Let io be the majority 
value of (T and let B — {k : a (k) — i}. Let i s+ i be the majority value of 
a s \ B s and let B s+ i = {k : a s+ i(k) = i s +i} n B s . The cardinality of B p („) is 
at least i ■ 2~ p ^ and A \ B p i n \ is a constant a n . Let i n be much larger than 
it, t <n. 

If for infinitely many n, a n = then there is N G £ on which A is not 
dominating, so A is not in SDI. Otherwise, all but finitely many a n = 1, and so 
^4 is not immune. □ 
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DNR 2 




IM 



Figure 1: Some Medvedev degrees. See Figures [2] and [3] for definitions. 
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■>■ Muchnik above 



Included in 



Not Medvedev above 



> Medvedev above 
Figure 2: Meaning of arrows. 



Abbreviation 


Unabbreviation 


Definition 


DNR 


Diagonally non-recursive function in cj" 




DNR„ 


Diagonally non-recursive function in n u 




MLR 


Martin-L6f random 




KLR 


Kolmogorov-Loveland random (MLR= S KLR) 




SR 


Schnorr random 




KR 


Kurtz random (weakly 1-random) 




MWC 


Mises-Wald- Church stochastic 


11.31 


KLS 


Kolmogorov-Loveland stochastic 


PI 


SBI 


Stochastically bi-immune 


1331 


BI 


bi-immune 


P 


IM 


immune (equivalently under = s : noncomputable) 


PI 


{H,l) 


effective Hausdorff dimension 1 


|3.14| 


(H, > 0) 


effective Hausdorff dimension > 


|3.14| 


(P.l) 


effective packing dimension 1 


|3.14| 


(P, > o) 


effective packing dimension > 


|3.14| 


(cp, 1) 


complex packing dimension 1 


|3.14| 


(cp, > 0) 


complex packing dimension > 


13.141 


COM 


complex in the sense of [10] 


|3.16| 


ED 


eventually different 


|3.12| 


Cohen generic 


not computable from a 2-generic set 




CT 


computably traceable 




WCET 


weakly c.e. traceable 


13.181 



Figure 3: Abbreviations used in Figure [TJ 
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Definition 3.12. A function f £ w u is eventually different (ED) if for each 
computable function g £ ui u , {x : f(x) = g(x)} is finite. 

Theorem 3.13. SBI > s ED. 

Proof. Let A £ SBI and suppose the function f(n) = A \ J„ is equal to a 
computable function g(n) for each n £ C ', where C £ £. 

Here /„ are large (size £) disjoint intervals. Let £ n be much larger than £ t , 
t < n. 

Consider the set M of majority positions on the strings g(n), n £ C. 
Either infinitely often the majority is 0, or infinitely often it is 1. Either way 
M witnesses that A SBI. □ 

Definition 3.14. The effective Hausdorff dimension o/ie 2" is 

liminf^iM. 

neuj n 

The complex packing dimension of A £ 2" is 

j. / a\ • r K{A \n) 
dim™ (A) = sup mf . 

The effective packing dimension of A £ 2" is 

K(A \ n) 
lim sup . 

ntEo; n 

Theorem 3.15. For all A £ 2 U , 

< dimjj(yl) < dim™ (A) < dim p (yl) < 1. 

Proof. The inequality dim# [A) < dim™ (A) uses the fact that each cofinite set 
N C uj is in £. The inequality dim™ (A) < dim p (A) uses the fact that each 
N £ € is an infinite subset of uj. □ 

Definition 3.16 (PS]). A £ 2" is complex if there is an order function h with 
K(A \ n) > h(n) for almost all n. 

The terminology complex packing dimension is due to the following theorem. 
There is similarly a natural notion of autocomplex packing dimension dim ap , 
obtained by requiring the set N to be recursive in A, with the property that 
dim ap (A) > implies that A is autocomplex |10) . but we will not study it here. 

Theorem 3.17. If dim cp ( A) > then A is complex. 

Proof. Suppose dim cp (A) > 0. Then there is an N £ £ and an e > 0, e £ Q 
such that inf ne Ar K[A \n)/n > e. Thus for all n £ N, K(A \ n) > en. Let 
N = {n n < n\ <•••}, let m t = \n t /e~\, and let f(t) = A \ m t . Then 
K{f{t)) > t and / < wtt A. Now [101 Theorem 2.6(4)-(6)] implies that A is 
complex, once we notice that the proof given there works equally well for prefix 
complexity as for plain complexity. □ 
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Definition 3.18 (Nies Q3]). A e 2" is facile if K{A \ n \ n) < h{n) for all 
order functions h and almost all n. If A is not facile then A is difficult. A 
is weakly c.e. traceable if for each order function p, for all computably bounded 
functions f <t A, there is a c.e. trace for f of size bounded by p. 

Theorem 3.19 (Nies [2]). A is weakly c.e. traceable iffVZ <t A, Z is facile. 

Theorem 3.20. A complex set cannot be weakly c.e. traceable. 

Proof. Suppose K(A \ n) > h(n) where h is an order function. Applying an 
inverse to h we get K{A \ g(n)) > n for an order function g. Then A f g(n) 
is computably bounded, and cannot be traced by a very small trace, or else it 
would have complexity O(logn). □ 

Theorem 3.21 (Merkle [11]). If A is MWC- stochastic then K(A \ n) ^ 
O(logn). 

Corollary 3.22. If A is MWC -stochastic then A is difficult. 

Lemma 3.23. Suppose f(n) = * n +^ n) . If X £ MLR and X x / Y then 
dim cp (F) >l-6. 

Proof. Suppose there are at most f(n) many bits changed to go from the random 
real X to the real Y, in positions oi, . . . ,a,ft n )- (In cases there are fewer than 
f(n) changed bits, we can repeat ai representing the bit which we may assume 
is changed.) Let (Y \ n)* be a shortest description of Y \ n. From the code 

\K(Ytn)\^ 1 ^ K( y r nr(Y r n) *~ ai . . . a/(n) 

we can effectively recover X \ n. Thus 

n - ci < K(X f n) < 2 log[K(Y \ n)] + 1 + K{Y \ n) + f(n) log n + c 2 
< 21og[n + 21ogn + c 3 ] + 1 + K(Y \ n) + /(n)logn + c 2 . 

Hence 

n < + 3 log n + K(Y \ n) + f(n) log n, and 
n - (f(n) + 3) logn <+ K(Y \ n). 
Thus dim p (Y) > S + e for each e > 0. □ 

Since the numbers n s+ ± are computable, the reals we obtain have effective 
packing dimension 1 in an especially effective way. 

Theorem 3.24. For each Turing reduction procedure $ there is a set Y with 
dim cp (Y~) = 1 such that $ y is not MWC- stochastic. 

Proof. Let p(n) — n 2 ^ 3 , so that p(n) — o(n/logn) and p(n) — ui*(^/n). By 
Theorem 13.91 for each weakly 3-random set X there is a set Y ^ p X such 
that <£> y is not both co- immune and in SD]/ 2 , in particular $ Y is not MWC- 
stochastic. By Lemma T3.231 each such Y has constructive dimension 1. □ 
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We can argue that it is not surprising that Theorem 13 . 241 holds: A 1-generic 
set G satisfies dim p (G) = 1, but does not compute an ED function. An MWC- 
stochastic set uniformly computes an ED function. Thus, were Theorem 13 . 241 to 
fail, the mere knowledge that a computable set N exists witnessing dim cp (Y) = 
1, without knowing an index for N, would somehow allow to compute an ED 
function. Our results do not rule out the possibility that for each N € £ and 
c E uj and / there is a $ which produces an MWC-stochastic set from any set Y 
with K(Y \ n) > n- (f(n) + 3) log n- c for aline N, and Theorem should 
not be taken as evidence that the analogous result for Mucnik reducibility holds. 

It seems potentially more surprising that one cannot uniformly get a SDI~ 
set from a set with dim cp = 1, since in this case we do not yet know whether a 
1-generic set computes such a set. 
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